MTP: Multi-Token Prediction
MTP is a speculative decoding method where the target model includes native multi-token prediction capability. Unlike draft-model-based methods, we don’t need separate draft models.
MTP is a speculative decoding method where the target model includes native multi-token prediction capability. Unlike draft-model-based methods, we don’t need separate draft models.
Date: 2026-07-22 Wed